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Response to Arguments 

Applicant's arguments filed on 09/21/2007 have been fully considered but they 
are not persuasive. 

1. Regarding claims 1-3 and 9-10 applicant argues on Page 9 that Bruckhaus 
does not however use this color information to calculate a representative color 
layout feature representative of the image sequence from a group of layout 
features, the examiner disagrees. Bruckhaus discloses this starting from abstract 
in which the "unit extractor 215" is a feature-extracting unit and the "image 
engine" generates an image representative of the sequence based on the unit. 
Bruckhaus further disclose at (Col 4 Lines 38-43) where the unit is a set of 
integral pixels representing a colored layout features such as orange colored 
pixels. After the unit extractor extracts the colored layout features (units), the unit 
distinction engine looks for the common pixel groupings in the frames of the 
selected sequence and recognizes the like units (color layout features) at (Col 5 
Lines 1-9). Bruckhaus further disclose the "unit predominance engine 225" 
which determines and computes the predominance of each unit by examining 
unit attributes (color brightness or luminance, motion etc) at (Col 5 lines 16-25). 
Bruckhaus further disclose at (Col 5 Lines 32-34 and 43-45) "unit 
representation engine 230" which selects the units that best represents the 
video sequence based on the infomiation from the predominance engine. 
Therefore Bruckhaus clearly discloses that the color layout features are extracted 
by the "unit extractor 215" and "unit predominance engine 225" and the 
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"unit representation engine 230" computes or calculates the best Image 
sequence representation of the selected units (color layout features). 

Applicant further argues on (Page 10 Lines 1-5) that, Bruckhaus does not 
disclose the color layout features defined in the specifications such as color 
luminance etc, the examiner disagrees. Bruckhaus discloses attributes (color 
brightness and motion that are color luminance and difference in color due to the 
motion at (Col 5 Lines 16-25). Although the claims are Interpreted in light of the 
specification, limitations from the specification are not read into the claims. See 
In re Van Geuns, 988 F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). 

2. Regarding Claims 12-15,22 and 23 applicant argues on page 10 Lines 14-19 
that Nagasaka (US 6400890) falls to disclose calculating a representative color 
layout feature representative of an image, the examiner disagrees. Nagasaka 
discloses this in Figs 1-5. Nagasaka further discloses in Fig 2 "feature table 
generator 110 and feature table 114" which shows the representative image 
(calculating the compressed image representative of the extracted features 
at Col 5 Lines 35-53) from the features (color of the frames) extracted by the 
"frame feature extractor 106". Therefore Nagasaka clearly discloses the final 
image representative is calculated (compressed to minimum quantity) from 
the extracted features by the above-mentioned units. 
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3. The newly amended Claim 19 is not part of the original species I election, 
therefore it has not been considered. See the response to requirement for 
restrictions filed on November 29,2004 by the applicant. 

Claim Rejections • 35 USC § 102 



The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 



Claims 1-3 and 9-10are rejected under 35 U.S.C. 102(b) as being anticipated by 
Bruckhaus (US 6052492) hereafter Bruckhaus. 



4. Regarding Claim 1, Bruckhaus discloses an image description system in (Figs 
1,2 and 3) comprising: a feature extracting unit (Elennent 215 Fig 2) extracting 
color layout features from respective of frames of an image sequence at (Col 4 
Lines 35-56 and Col 10 Lines 25-41); and a representative feature calculating 
unit (Element 230 Fig 2) calculating a representative color layout feature 
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representative of said image sequence from a group of said layout features of all 
frames extracted by said feature extracting unit at (Col 8 Lines 24-41 and Col 
10 Lines 25-46). 

5. Regarding Claim 2, Bruckhaus discloses an image description system (Figs 
1,2 and 3) comprising: a feature extracting unit at (Element 215 Fig 2) extracting 
color layout features from respective of frames of an image sequence at (Col 4 
Lines 35-56 and Col 10 Lines 25-41); a representative feature calculating unit at 
(Element 230 Fig 2) calculating a representative color layout feature 
representative of said image sequence from a group of said color layout features 
extracted by said feature extracting unit at (Col 8 Lines 24-41 and Coj 10 Lines 
25-46); and a representative layout feature storage unit storing said 
representative color layout feature (Memory 900 Figure 9) calculated by said 
representative feature calculating unit at (Col 8 Lines 24-41 and Col 10 Lines 
25-46). 

6. Regarding Claim 3, Bruckhaus discloses an image description system (Figs 
1,2 and 3) comprising: a feature extracting unit at (Element 215 Fig 2) extracting 
color layout features from respective of frames of an image sequence at (Col 4 
Lines 35-56 and Col 10 Lines 25-41); a representative feature calculating unit 
(Element 230 Fig 2) calculating a representative color layout feature 
representative of said image sequence from a group of said color layout features 
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extracted by said feature extracting unit at (Col 8 Lines 24-41 and Col 10 Lines 
25-46); a representative layout feature storage unit storing said representative 
color layout feature (Memory 900 Figure 9) calculated by said representative 
feature calculating unit; and a layout feature group storage unit storing said group 
of color layout features (Memory 900 Figure 9) calculated by said feature 
extracting unit at (Col 4 Lines 35-44 and Lines 53-56). 

7. Regarding Clainfi 9, Bruckhaus discloses an image description software 
product embodied on a computer readable medium, said software product having 
instructions executable on a computer for performing the steps (Figures 1 and 2) 
comprising: extracting color layout features from respective of frames of an 
image sequence; and calculating a color layout feature representative of said 
image sequence from a group of said color layout features extracted by said 
feature extracting function at (Col 3 Lines 24-40 and Col 4 Lines 1-11). 

8. Regarding Claim 10, Bruckhaus discloses an image description method 
comprising: extracting color layout features from respective of frames of an 
image sequence by an (Element 215 Fig 2); and calculating a color layout 
feature representative of said image sequence from a group of said color layout 
features extracted in said extracting at (Col 8 Lines 24-41 and Col 10 Lines 25- 
46). 
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Claims 12-15, 22 and 23 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Nagasaka et al. (US 6400890) hereafter Nagasaka. 

« 

9. Regarding Claim 12, Nagasaka discloses an image identification system (Figs 
1,2 and Col 4 Lines 57-67 through Col 5 Lines 1-33) comprising: a 
representative layout feature storage unit (Fig 1 Element 9, Col 5 Lines 11-15) 
storing a color layout feature representative of an image sequence (Fig 2 
Element 116,118 and 120) as a representative color layout feature (Col 9 Lines 
37-43); a feature extracting unit (Element 106 Fig 2) extracting color layout 
features from respective of frames of a query image sequence; a representative 
feature calculating unit calculating a representative color layout feature 
representative of said query image sequence (Fig 2 element 100 and Col 5 
Lines 1-3) from a group of said color layout features extracted by said feature 
extracting unit (Element 106 Fig 2); and an image sequence selecting unit 
selecting a sequence which resembles said query image sequence (Fig 2 
element 100 and Col 5 Lines 1-3) by comparing (Fig 2 Element 130) said 
representative color layout feature calculated by said representative feature 
calculating unit with said representative color layout feature stored in said 
representative layout feature storage unit (Fig 2 Element 122 and Col 5 Lines 
15-19). The feature comparator (Fig 2 Element 130) performs the comparison 
and the unit 128 retrieves the results. 
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10. Regarding Claim 13, Nagasaka discloses an image identification system 
(Figs 1,2 and Col 4 Lines 57-67 through Col 5 Lines 1-33) comprising: a 
representative layout feature storage unit (Fig 1 Element 9, Col 5 Lines 11-15) 
storing a color layout feature representative of an image sequence (Fig 2 
Element 116,118 and 120) as a representative color (Col 9 Lines 37-43) layout 
feature; a layout feature group (array of features) storage unit storing color 
layout features associated with respective of frames of said image sequence (Fig 

1 Element 9 and Col 5 Line 20); a feature extracting unit (Element 106 Fig 2) 
extracting color layout features from respective of frames of a query image 
sequence (Fig 2 element 100 and Col 5 Lines 1-3); a representative feature 
calculating unit (Element 106,110 Fig 2) calculating a representative color layout 
feature (Fig 2 Elements 106,110,112 and 114) representative of said query 
image sequence from a group of said color layout features extracted by said 
feature extracting unit (Element 106, Fig 2); an image sequence selecting unit 
selecting an image sequence which resembles said query image sequence (Fig 

2 Element 100 and 102) by comparing (Fig 2 Element 130) said representative 
color layout feature calculated by said representative feature calculating unit (Fig 
2 Element 122 and Col 5 Lines 15-19) with said representative color layout 
feature stored in said representative layout feature storage unit; and an 
identification unit matching (Fig 2 Element 130) said group of color layout 
features extracted by said feature extracting unit (Element 122 Fig 2) against 
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said color layout features stored in said layout feature group storage unit (Fig 1 
Elenfient 9) as to said image sequence selected by said image sequence 
selecting unit (Fig 2 Elements 100,102 and 104). Nagasaka also discloses a 
case where queried images are prepared beforehand (storage) and target image 
is retrieved is used. Nagasaka further discloses where target images are queried 
images (Col 8 Lines 54-59). 

11. Regarding Claim 14, Nagasaka discloses the image description system 
wherein said representative feature calculating unit calculates average values of 
respective elements of a color layout feature extracted by said feature extracting 
unit as a said representative color layout feature in (Figs 1,2 and Col 9 Lines 
37-43). 

12. Regarding Claim 15, Nagasaka discloses wherein said representative feature 
calculating unit rearranges values of respective elements of a color layout feature 
extracted by said feature extracting unit in any of ascending order and 
descending order, and calculates a median as said representative color layout 
feature in (Figs 1,2 and Col 14 Lines20-36). 

13. Regarding Claim 22, Nagasaka discloses the image identification system 
according to claim 13. Nagasaka further discloses wherein said representative 
feature calculating unit calculates average values of respective elements of a 
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color layout feature extracted by said feature extracting unit as said 
representative color layout feature (Figs 1,2 and Col 9 Lines 37-43). 

14. Regarding Claim 23, Nagasaka discloses the image identification system 
according to claim 13. Nagasaka further discloses wherein said representative 
feature calculating unit rearranges values of respective elements of a color layout 
feature extracting unit in any of ascending order or descending order, and 
calculates a median as said representative color layout feature (Figs 1,2 and Col 
14 Unes20-36). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which fomis the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed 
or described as set forth in section 1 02 of this title, if the differences between the 
subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was 
made. 

Claims 4 and 5 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Bruckhaus in view of Nagasaka et al. (US 6400890) hereafter Nagasaka. 
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15. Regarding Claim 4, Bruckhaus discloses the image description system 
according to claim 1. Bruckhaus however is silent and does not disclose wherein 
said representative feature calculating unit calculates average values of 
respective elements of a color layout feature extracted by said feature extracting 
unit as a said representative color layout feature. 

Nagasaka discloses the image description system wherein said 
representative feature calculating unit calculates average values of respective 
elements of a color layout feature extracted by said feature extracting unit as a 
said representative color layout feature in (Figs 1,2 and Col 9 Lines 37-43). 
Nagasaka discloses the method and apparatus performs a high-speed retrieval 
of video images by the help of features at (Col 1 Lines 9-11). Both Bruckhaus 
and Nagasaka are from the same field of endeavor and are analogous art, 
therefore it would have been obvious for one of ordinary skill in the art at the time 
the invention was made to have used the teachings of Nagasaka in the system 
and method of Bruckhaus for the above reasons. 

16. Regarding Claim 5, Bruckhaus discloses the image description system 
according to claim 1 . Bruckhaus is silent and however does not disclose wherein 
said representative feature calculating unit rearranges values of respective 
elements of a color layout feature extracted by said feature extracting unit in any 
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of ascending order and descending order, and calculates a median as said 
representative color layout feature. 

Nagasaka discloses wherein said representative feature calculating unit 
rearranges values of respective elements of a color layout feature extracted by 
said feature extracting unit in any of ascending order and descending order, and 
calculates a median as said representative color layout feature in (Figs 1,2 and 
Col 14 Unes20-36). 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed 
within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Jayesh A. Patel whose telephone number is 
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571-270-1227. The examiner can normally be reached on M-F 7.00am to 4.30 
pm (5-4-9). If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Jingge Wu can be reached on 571-272-7429. The fax 
phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. Information regarding the status of an application may 
be obtained from the Patent Application Information Retrieval (PAIR) system. 
Status infonnation for published applications may be obtained from either Private 
PAIR or Public PAIR. Status information for unpublished applications is available 
through Private PAIR only. For more infonnation about the PAIR system, see 
http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 
(toll-free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 



Jayesh Patel 
10/16/07 




